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Abstract 

' We consider decentralized multi-antenna cognitive radio networks where secondary (cogni- 

C — ! 

tive) users arc granted simultaneous spectrum access along with license-holding (primary) users. 
We treat the problem of distributed beamforming and rate allocation for the secondary users 
such that the minimum weighted secondary rate is maximized. Such an optimization is subject 
to (1) a limited weighted sum-power budget for the secondary users and (2) guaranteed pro- 
tection for the primary users in the sense that the interference level imposed on each primary 
, receiver does not exceed a specified level. Based on the decoding method deployed by the sec- 

■ ondary receivers, we consider three scenarios for solving this problem. In the first scenario each 
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secondary receiver decodes only its designated transmitter while suppressing the rest as Gaus- 
sian interfercrs (single- user decoding). In the second case each secondary receiver employs the 



OO 
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0^ , maximum likelihood decoder (MLD) to jointly decode all secondary transmissions, and in the 



third one each secondary receiver uses the unconstrained group decoder (UGD). By deploying 
the UGD, each secondary user is allowed to decode any arbitrary subset of users (which contains 



^ ' its designated user) after suppressing or canceling the remaining users. 



1 Introduction 



In classical cognitive radio systems the secondary users can only transmit in white spaces which 
denote the frequency bands (or time intervals) that the primary (or licensed) users are silent [1]. 
On the other hand, in generalized cognitive radio systems, the secondary users can also transmit 
simultaneously with primary users, as long as certain co-existence constraints are satisfied [2,3]. 
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Clearly the latter systems can achieve higher spectral efficiencies but at the expense of additional 
side-information at the secondary users and increased signaling overhead. We consider decentralized 
multi-antenna cognitive radio networks where secondary transceivers can co-exist with primary 
ones. However, in our setup no secondary transmitter has access to any primary user's codebook. 
Instead, each secondary transmitter employs beamforming to communicate with its desired receiver 
while ensuring that the aggregate interference seen by each primary receiver does not exceed a 
specified level (interference margin). 

Our goal is to design optimal beamformers for the secondary users and assign rates to them 
in a distributed fashion, in order to maximize the smallest weighted rate among secondary users. 
This optimization is subject to a weighted sum-power constraint on the secondary users as well as 
the interference margin constraints imposed by the primary users. Based on the decoding scheme 
deployed by the secondary users, we consider three scenarios for solving this problem. In the 
first one each secondary receiver employs a minimum mean-squared error (MMSE) decoder and 
attempts to decode only the signal transmitted by its designated transmitter after suppressing 
the remaining signals via linear filtering (a.k.a. single user decoding). We propose an efficient 
distributed algorithm that yields a globally optimal set of beamformers. The resulting beamformers 
are optimal for networks which do not support exchange of codebooks among secondary transceivers 
or where more advanced decoding at the secondary receivers is not feasible due to complexity 
constraints. In this context we note that [4] has optimally solved the linear transmit beamforming 
problem in a MISO cognitive radio network ^ with a single secondary transceiver. A variation of 
the beamforming problem has also been optimally solved in [5] for a MISO cognitive radio network 
with a single secondary and a single primary transceiver but where the channel vector from the 
secondary transmitter to the primary receiver is imperfectly known to the secondary user. Other 
related works include [6] which is a comprehensive work on precoder design in MISO point-to- 
multi-point channels and [7] which proposes a distributed beamforming algorithm to minimize the 
weighted sum power subject to SINR constraints in the downlink MISO multi-cell network. 

In the second scenario, we assume that each secondary receiver is equipped with a maximum 
likelihood decoder (MLD) which is used to jointly decode all secondary transmissions. We show 
that in this scenario, the beamforming design problem can be posed as a non-convex optimization 
problem with a quadratic objective and indefinite quadratic constraints. Solving such a problem 



^ A cognitive radio network where all the receivers have a single receive antenna is referred to here as a MISO 
cognitive radio network. 
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optimally in its general form is intractable [8]. Nevertheless, after a convex relaxation it can 
be converted to a semi-definite program (SDP). This design procedure for MLD requires central 
processing and does not seem practical for decentralized cognitive networks. 

In the third scenario, we assume that each secondary receiver uses the unconstrained group 
decoder (UGD) [9] and is allowed to jointly decode any subset of secondary users containing its 
desired user, after suppressing or canceling the rest of users. We provide an explicit formulation of 
the optimization problem for this scenario. The resulting problem is non-convex and hence cannot 
be efficiently solved even in a centralized setup. 

As a remedy for the MLD and UGD, we adopt a two-step sub-optimal approach. In the first 
step, we obtain a set of beamformers which is optimal under MMSE decoding at each receiver. In 
the second step, in order to boost the spectral efficiency we exploit the fact that the secondary 
users by employing more advanced decoders can support higher data rates. Therefore, we propose 
allocating excess rates to the secondary users beyond their minimum acceptable rates, such that 
(1) weighted max-min fairness is maintained, (2) all the secondary users remain decodable at their 
respective receivers and (3) the rate assignment is pareto-optimal. A key feature of our proposed 
distributed rate allocation algorithms is that the complexity at each secondary receiver is only 
polynomial in the number of secondary users. In this context, we note that efficient rate allocation 
in a single-antenna interference channel (IC) with single-codebook and fixed power per-user has 
been recently investigated in [10, 11]. In particular, [11] considers a i^'-user IC where each user 
employs the successive interference cancelation (SIC) based decoder and obtains a max-min fair 
decentralized rate allocation algorithm. [10] considers an K-usei Gaussian IC and solves the problem 
of maximizing the desired user's rate at a particular receiver given the transmission rates of the 
other users. In addition, [10] also proposes sequential and iterative rate allocation algorithms which 
yield pareto-optimal rate-vectors albeit without a fairness guarantee. 

The remainder of the paper is organized as follows. The model of the multi-antenna cognitive 
network is provided in Section [2] and the statements of the beamforming and rate optimization 
problems are formalized in Section [3l The design of the beamformers for the MMSE, ML and 
UGD receivers are discussed in Section |4] where we also provide a distributed algorithm for opti- 
mally solving the problem for MMSE receivers. Leveraging this beamforming design procedure, in 
Section [5] we consider the MLD and the UGD and provide distributed weighted max-min fair rate 
allocation algorithms for further boosting the rates of the secondary users. The simulation results 
are provided in Section [6] and Section [7] concludes the paper. To enhance the flow of the paper 
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most of the proofs are confined in the appendices. 

2 System Model 

We consider a decentrahzed cognitive network comprising of Mg secondary transmitter-receiver 
pairs co-existing with Mp primary transceiver pairs via concurrent spectrum access. The secondary 
transceivers form a multi-antenna Gaussian interference channel (GIG) where Mg transmitters each 
equipped with Ng transmit antennas communicate with their designated single-antenna receivers. 
The primary transmitters and receivers have Np and 1 transmit and receive antennas, respectively. 
We assume quasi-static flat fading channels and denote the channels from the j^^ secondary trans- 
mitter to the i*^ secondary and primary receivers by ^J^'J G (j^i^^s and hF^^ G C^^^^, respectively, 
and denote the channels from the j*^ primary transmitter to the i^^ secondary and primary receivers 
by /i,';J G C^^^f and hf^ G C^^^f , respectively. 

Let xl and be scalar complex- valued random variables with unit power, i.e., E[|j;|p] = 
^[l^f P] — 1) representing the information symbols of the i^^ secondary and primary transmitters, 
respectively and let G C^''^^ and w^- G C^''^"'^ denote their respective beamforming vectors. 
The received signals at the z*^ secondary and primary receivers are given by 

Ms Mp 

yt ^ Y.K>y3 + Y.^'>V3+'t, fori = l,...,M„ (1) 

Ms Mp 

and yf ^ E ^':>^S' + E + ' for ^ = 1, . . . , M^, (2) 

where , G C are the additive white Gaussian noise terms with variances af and erf, respectively. 
No primary (secondary) receiver tries to decode the signal intended for any secondary (primary) 
user. 

3 Problem Statement 

We denote the rate assigned to the i*^ secondary user by i?j and we will say that for the given channel 
realization, choice of transmit beamformers and decoders employed by the secondary receivers, the 
rate vector R = [Ri, . . . ,Rms] is decodable (strictly decodable) if for any rate vector R ~< R 
{R ^ R) and any arbitrarily fixed e > 0, there exists a set of Mg codes such that each secondary 
receiver can decode its desired user (secondary transmitter) with a probability of error no greater 
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than e. The interference level seen by the i^^ primary receiver due to secondary transmissions is 
denoted by Ji and is given by 

•^* = El'^':>f ' i = l,...,Mp. (3) 

i=i 

The i^^ primary receiver specifies a parameter /5j which is the maximum interference it can tolerate 
from secondary transmissions. Let J = [Ji, . . . , Jm^] and define the interference margin vector 
f3 = [(3i,. . . ,PMp]- We are interested in solving the following rate optimization problem. 

For the given set of channel coefficients, choice of primary transmit beamformers, and decoders 
employed by the secondary receivers, we seek to maximize the worst-case secondary weighted rate 
such that the secondary weighted sum-power is below Pq and the interference seen by the i*^ 
primary receiver does not exceed i.e., 

max^, {i,;-} mini^, 

s.t. E.=\«.IKf <^o, 

R is decodable. 



where {pi}f^i and are all positive and account for weighting the individual rates and powers 

of the secondary users, respectively. Note that by definition, if R is decodable then any rate vector 
R, where ^ R ^ R, is also decodable. Furthermore, the optimization problem in ^ is always 
feasible. We show that solving the rate optimization problem corresponding to TZ{Po) can often be 
facilitated by alternatively solving a power optimization problem given by 



Vip) 



EM, II 9 1 1 2 
i=i'^i\m\\. 



s.t. J r< A (5) 
Rate p is decodable, 



where p = [pi, . . . , pMs]- Note that the optimization problem in ([5]) is not necessarily always feasible 
and we adopt the convention V{p) = oo when the problem is infeasible. It can be readily verified 
that TZ{P()) is continuous and non-decreasing in Pq. Moreover, V{p ■ po) is also continuous and 
increasing in po at any strictly feasible rate po ■ p, i.e., at any strictly decodable rate vector po " P 
for which the margin constraints in ([5]) are satisfied with strict inequality. The rate and power 
optimization problems are related as follows. 
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Theorem 1 For any arbitrary set of OL,p,(5, the rate and power optimization problems correspond- 
ing to TZ{Pq) and V{p) are related as follows 



V (7^(Po) • P) < ^0 



(6) 



and if (0j is feasible then 



n{v{p)) = i. 



Proof: See Appendix El 



Thus, the rate and power optimization problems can be deemed as complementary. It is notewor- 
thy that the inequality in ([6]) becomes equality only if the weighted sum-power constraint in the 
rate optimization problem corresponding to TZ{Pq) holds with equality at each one of its optimal 
solutions. Also, for each choice of decoders considered in the sequel, strict inequality holds in ([6]) 
only if at-least one of the margin constraints in the power optimization problem corresponding to 
V (JZ{Pq) ■ p) is active at each of its optimal solutions. This follows from the fact that for any 
given set of beamformers, wherein all secondary beamforming vectors are non-zero, we can strictly 
increase the rates of all secondary users by scaling their powers identically. 

4 Beamformer Design 
4.1 MMSE Receivers 

In this section, we assume that each secondary receiver uses the MMSE single-user decoder which 
only decodes its desired user and treats the other users as Gaussian interferers. Then, for a given 
set of channel coefficients and choice of beamformers, the rate that can be achieved for the i*^ 
user is Ri = log(l + SINRj), where SINRj denotes the signal-to-interference-plus-noise ratio at the i^^ 
secondary receiver and is given by 



We first provide a distributed algorithm for solving V{p). Then, by exploiting the connection 
between the problems 1Z{Pq) and 'P(p), as established in Theorem[Tl we use this algorithm to obtain 
another distributed algorithm for solving TZ{Pq). By defining 7^ = 2^^ — \ and 7 = [71, . . . ,7j\/s] 





(7) 
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the optimization problem in ([5]) becomes equivalent to the problem 



mm 



EMs II 

s.t. SINRj > 7j, for i = 1, . . . , Ms, 

J ^(3. 



.s||2 



(8) 



For solving the problem 7^(7) we start off by investigating the feasibility of this problem. Next, 
we show that the problem can be solved efficiently as a second-order cone program (SOCP) and 
then propose a distributed algorithm that finds its globally optimal solution while abstaining from 
requiring a central controller. 

For any set of channel realizations h^'j , h^'J, hf^ & hfj, and given q;,7,/3 we define 



J-p.S A 

= 



h ' 

laiW^ and j 



for 1 = 1, 



for i = 1, . . . , Ms, 

Ms, 



a. 



.,Mp and j = 1, 



and h 



fori / j, i,j = l,...,Ms. 



(9) 



Therefore, we can rewrite problem V{'y) as follows 



s.t. 



> 1 for i = 1, 



(10) 



> 1 for i = 1, 



,Mp. 



Keeping the interference to the primary users as well as other secondary users low suggests using 
beamforming vectors with small transmit powers. On the other hand, for small transmit powers 
the secondary receivers may violate their SINR constraints. Due to this tension, it is not always 
possible to have feasible solutions for {wf}. Therefore, we first provide a necessary condition for 
examining the feasibility of ^(7). For this purpose, we first define = ||"^p^||2 for z = 1, . . . , Mp, 
and 
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Therefore, we can re-write the Ms + Mp constraints of (jlOp as 



irrt^i 12 I (■\ - ^' (11) 



where cr = [erf, . . . , cr^^^, OixAfp] 



Lemma 1 Problem V{'y) is feasible only if the channel realizations are such that 

rank(Q) > ^ . 

Proof: See Appendix [Bl ■ 
A simple sufficient condition for feasibility is given next. It uses the fact that if each secondary 
transmitter can employ a beamformer which causes zero interference to all unintended receivers but 
yields a positive signal strength at the intended receiver, then any given set of SINRs are achievable. 
Let iJ^j, V i be the {Ms + Mp — 1) x Ns matrix whose rows are the outgoing channel vectors of the 
i*'' secondary transmitter corresponding to all its unintended receivers. 

Lemma 2 Problem V{'y) is feasible for any finite 7 if the channel realizations are such that for 
each secondary transmitter i 

{h^;:f i Range{(J/^)^}. 

In the subsequent analysis we assume that the optimization problem "^(7) is strictly feasible. 
Note that the optimization problem ^(7) is not convex in its direct form. Nevertheless, we can 
show that strong duality holds for this problem by arguing that this problem can be transformed 
to an SOCP which has a linear objective function and second order cone constraints and is convex. 
The same idea has been employed for precoder design in downlink MISO point-to-multi-point 
channels [6]. 

Lemma 3 Strong duality holds for V{'y), i.e., it has zero duality gap with its Lagrangian dual. 

Proof: See Appendix O ■ 
When all the channels are known to a central agent, as shown in the Appendix, the problem V{'y) 
can be solved efficiently as an SOCP. In a distributed network, however, each secondary transmitter 
has access only to limited channel state information. Here, we do not assume global channel 
state information at each secondary user. Instead we assume that primary users have no side- 
information about the secondary channel states and each secondary user only knows its outgoing 
(forward) channels to all the secondary and the primary receivers. In addition, each secondary 



user also knows all the incoming channel vectors seen by its intended receiver from other secondary 
users as well as the effective noise variance (i.e., thermal noise variance plus the interference due 
to primary transmissions) at its intended receiver. Lack of complete knowledge of channel state 
information at the secondary transmitters necessitates developing distributed algorithms to be run 
by the secondary users in a decentralized fashion with limited message passing among themselves. 
In the sequel we develop a distributed scheme which yields the global optimal solution of 7^(7) by 
solving its Lagrangian dual problem. 

We construct the partial Lagrangian function of the problem V{-f) given in (jlOp by dualizing 
only the interference margins. For a non-negative set of multipliers A = [Ai . . . XMp]'^, associated 
with the interference margins, the Lagrangian function is given by 



Li{wn,\) 



i=l 



Ms 

E 

i=l 



s\H 



i=i 

Mr, 



.s\2 



1 



i=l 



j=i 



Mp 



A,. 



It is easy to verify that I + Yl!j'=i{^'l)^^^i^i positive definite for all i, and by the Cholesky 
decomposition we know that there exists an invertible triangular matrix Ui such that 



Mp 



J' 



(12) 



where ?7j, although not explicitly shown, depends on A. Therefore, since we have incorporated only 
the interference constraints in formulating the Lagrangian function, the Lagrange dual function is 
given by 



9W = 
where we have defined 



s-t. E^il&?l'-2|C*fP + a|<0 fori = l,, 



.Ms, 



(13) 



at ^ ElK'Ml' + < forz = l,...,M,. 
i 

By further defining = Uiwl and A^'^* = li-^^Uj^ we get 
5(A) = 



mm 



s.t. 



>1 for i = 1, . . . ,Ms. 



(14) 



(15) 
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Note that for any given set of {Aj}, the term Ylj=i is constant and the problem in (jlSp is equiv- 
alent to minimizing J2i=i{''^i)^ '^t • It can now be verified that the problem in (fT5|) is equivalent to 
the optimization problem in [7] which considers beamforming design over downlink MISO multi-cell 
networks. In particular, [7] aims to minimize the weighted sum power subject to SINR constraints 
for the users in different cells and proposes an algorithm for solving this problem in a distributed 
way (the base stations do not collaborate for designing their beamformers). The underlying idea of 
this distributed algorithm is to exploit the uplink-downlink duality in multi-antenna transmissions. 
By leveraging the approach in [7], we can show that for any given set of {Aj}, g{\) can be computed 
in a distributed way. 

On the other hand, by using the result of Lemma [3] that strong duality holds for V{y), we know 
that 

max 5(A) = P(7). (16) 

Therefore, we utilize the subgradient method which provides a simple algorithm for minimizing such 
convex problems with possibly non-differentiable objective function [12]. We apply the subgradient 
method on ^(A) = —g{\) (which is convex). According to the subgradient method, we use the 
following iterative procedure to minimize g : M.^^p — > M. 

A(^-+i)=A(^)-//,s('=), 

where s'^^'^ is any subgradient of g at A^'^^ Recall that a subgradient of g at A^'^^ is any vector s*^^-* 
that satisfies ^(A') > ^(A^^^)) + (s('=))^(A' - A^'')), VA' and i^ik > is the k*'' step size. Since the 
subgradient method is not a descent method, at each iteration we need to keep track of the best 
point found thus far, i.e., 

#it = min{Ct^\^(AW)}. 

The subgradient method is guaranteed to converge to the optimal value for non-summable di- 
minishing step sizes, i.e., lim/^.^oo^fc = and Yl'k^i f^k = oo [12]. Hence, to be able to use the 
subgradient method we need to find a valid subgradient and a step size. We select IJ-k = \ which 
can be easily seen to be a non-summable diminishing step size. Also we argue that for any point 
AC^), ^ [sf 4)] such that 



sf = 1 - V \h'';;u,\\ for J = 1, . . . , Mp, where {u^] = arg min L{{wl], A^'^)), (17) 
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is a valid subgradient, since VA' 



9iX') = -g{X') = -^ min L({ii|},A' 



Ms r Ms 



f l\ls ^"P r ivis -1 \ 

i=l j=l ^ i=l ^ ^ 

( Ms Mp Ms n ^ r 

= -{ E + E E - 1 } + E(^; - ) 1 - E i"?.-.! 



i=i j=i 

= - min L({iLf},A('^)) + (sWf (A'- aW) =5(A('^)) + (s('^)f (A'- A^'^)) (18) 

Therefore, by the aforementioned choices for s^^'^ and /i^ the subgradient method is guaranteed to 
converge to the optimal value and thus, yields the minimum of —9(A) or the maximum of g{X) 
which is the optimal value of P(')'). Algorithm 1 summarizes the steps involved in obtaining V{'-f ). 

In practice, for implementing Algorithm 1 we allow a specified maximum number of iterations. 
If no convergence is observed, we declare the power minimization problem to be infeasible and set 
P(7) = 00. 

Finally, in order to solve the optimization problem 7^(Po) we exploit the relationship between 
V{p) and TZ{Pq) given in Theorem [TJ Using Algorithm 1, along with a bi-section search, in Algo- 
rithm 2 we provide the steps for solving 1Z{Pq). For initializing the algorithm we need lower and 
upper bounds on the (optimal) TZ{Pq), which we denote by p^\a and Pmax, respectively. For both 
bounds, we use beamforming vectors obtained via channel matching, i.e., we set to be a scalar 
multiple of {hl'D^ /\\hl'l\\. In particular, for obtaining Pmin, we set wf = \fdi{hl'l)^ /\\hl'l\\, V i, 
where a is the largest positive scalar such that the power and margin constraints are satisfied. For 
obtaining Pmax, we assume the presence of a genie which ensures that the transmission intended for 
any particular secondary receiver causes no interference to any other receiver and can use all the 
available power, so that the optimal secondary beamformers are {"^j^qy^^^^l- Note that Algorithm 
2 always returns a feasible p and {wf\. 

4.2 Maximum Likelihood Decoders 

In this setup each secondary receiver deploys the MLD which jointly decodes all transmitted sec- 
ondary codewords and is optimal only with respect to the joint error probability. Recall that each 
secondary receiver is interested in recovering only the codeword transmitted by its designated sec- 
ondary transmitter. Therefore, the i^^ receiver secondary will declare an error if and only if it fails 
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to decode the codeword of its desired secondary user i. 

For each user i we define the sets V^, for k = 1, . . . , 2^^""^, to be all possible subsets of 
{1, . . . , Ms} which contain i, i.e., i G Vf, V k. In the following lemma we provide a sufficient 
condition for a rate vector R to be decodable. This condition explicitly incorporates the effect of 
the channel coefficients and beamforming vectors on the decodability of rate vector R. 

Lemma 4 When all secondary receivers employ MLD, a sufficient condition for a rate vector R 
to he decodable is 

^k, log + ^^pjy^^'^'ls] > E /or z = l,...,M,. (19) 

Proof: See Appendix |Dl ■ 
Note that the usual achievable rate region for the MLD is obtained under the restriction that all 
codewords can be reliably decoded. In particular, this region is the set of all rate vectors, R which 
satisfy 

log 1+ ^gj y I' ^ >^Rj, V^, 5C{1,... ,Mj&5/(/). (20) 

The condition we derived in (I19p is more relaxed compared to the one in ()20p . since we only need 
the if'^ user to be decodable at the z*^ receiver. While we do not prove that the condition in (|19p 
is also necessary, we note that using the approach in [13], it can be argued that a decoding error 
for user i at receiver i is very likely if the condition in (jl9p is not satisfied. 

Next, we define the vector w = [{wf)'^ , . . . , [wfjj'^]'^. Also, corresponding to each subset Vf 
we construct an NgMg x NgMg square matrix that consists of square sub- matrices each 
of dimension Ng x Ns- The {j,jY^ sub-matrix in for each j G is —{h^'j)^h^'j and other 
sub-matrices are 0. Further, for a rate vector p, corresponding to each Vf we define the scalar 

j 

Therefore, the conditions in p9]) can be rewritten as w^B^w — c^ < 0,\/i,k. The primary 
interference margin constraints J ^ P can also be restated as BiW — A < 0, where consists 
of square sub-matrices each of dimension Ng x Ns, such that the sub-matrix, for 1 < 

j < Mg, is {h^'j)^ h^'j and other sub-matrices are 0. 
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By defining A = diag[ai, . . . , oMs] ® the power minimization problem is given by 

/■ 

min^y w^Aw, 

< s.t. w^B'^w - < Vi, k, (21) 
w^BiW - A < Vi. 

The problem in (j2ip is a non-convex problem with a quadratic objective and indefinite quadratic 
constraints which in its general form is an NP hard problem [8]. Several approaches have been 
developed for solving this problem sub-optimally, including a convex relaxation approach which 
converts the problem to a semi-definite program (SDP) described as follows. 
By defining X = ww^ , we obtain the problem 

minx tr(XA), 

s.t. tr(Sf X) -c) <^ Vi, k, 

^ ' ' ' - (22) 

tT{BiX) - Pi<0 Vi, 
X = ww^ . 

V 

By relaxing the constraint X = ww^ and replacing it with the convex constraint X ^ the 
problem becomes an SDP which is a convex problem and can be solved efficiently. We denote the 
solution of the SDP by X*. Note that a feasible solution for (j22|) should be a rank-1 matrix, which 
is not necessarily true for the solution of the SDP. There are several methods to recover a rank- 
1 solution, see [14] where such methods are discussed in the context of multi-cast beamforming. 
Here we adopt a simple approach and first determine the dominant eigenvector of X and denote 
it by "UJ = [{wl)'^ , . . . , i'w^j^jj'^]'^. Then for finding a feasible w we set = ^^piW^ /\\wf\\, where 
1 < i < Ms and {pi} are positive scaling factors which can be found by solving a linear program 
(LP) which minimizes the weighted sum power under the constraints that the rate and margin 
constraints are satisfied. In case either the SDP or the LP are infeasible, we declare the power 
minimization problem to be infeasible. Finally, in order to solve the rate optimization problem we 
can exploit the relationship between V{p) and 1Z{Pq) given in Theorem[T]and use the aforementioned 
power minimization technique along with a bi-section search similar to the one provided for the 
MMSE receiver in the previous section. While such a method provides a sub-optimal design of the 
beamforming vectors for the MLD, a drawback is that it cannot be implemented in a distributed 
way. 
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4.3 Unconstrained Group Decoders 

In this section we assume that each secondary receiver is equipped with the unconstrained group 
decoder (UGD) [9]. Note that a drawback of the MLD is that it decodes ah secondary users which 
entails a high decoding complexity and can degrade performance in cases when some of the other 
users are best treated as noise. In fact a rate vector decodable using the MMSE decoder at each 
receiver need not necessarily be decodable upon using the MLD at each receiver. The UGD on the 
other hand, may decode the designated user jointly with any arbitrary subset of other secondary 
users, after suppressing or canceling any other subsets. As a result, any rate vector which is 
decodable by MMSE or ML decoders, it is also decodable by the UGD. In the following remark we 
first state a sufficient condition for a subset of users to be decodable when the UGD is deployed at 
each secondary receiver. 

Remark 1 A subset of users U C {l,...,Ms} is decodable at the i*^ receiver under the rate 
assignment R if for all non-empty sets A^U we have 

log f 1 + ^^^AK^^f \ ^23) 

Moreover, if for an ordered partition {Qi, • • • , Qp} of any subset Z// C {1, . . . , Ms}, the set Qj, where 
^ < j <P, is decodable at the i*^ receiver after expurgating users in {Qi, ■ ■ ■ ,Qj-i}, i.e., 




log I 1 + ^ ^ 

then we have that the set U = ^g^iGq is also decodable. 

As a result, a sufficient condition for user i to be decodable at the i^'^ receiver when the UGD is 
deployed is that there exists a decodable subset U containing i. It is informative to notice here that 
the worst case decoding complexity of the UGD is equal to the decoding complexity of the MLD. 
Also, suppose no subset containing i satisfies the condition in (j23p . In this case, using the results 
from [9] we can conclude that user i belongs to a unique undecodable set at receiver i, so that a 
decoding error for user i is very likely if we attempt to decode i using the UGD. 

For the purpose of making the optimization formulation more intuitive we assume identical rate 
weighting for all secondary users, i.e., for all users we set p = pi. As a result, the optimal design 
assigns identical rates to all users so that Rj = R, V j. Generalization to an arbitrary weight 
vector p is possible by following the same approach. The following remark is helpful in identifying 
a decodable subset (if any) at receiver i containing user i. 
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Remark 2 // the i*^ secondary user is decodable at receiver i, then all users k G {1, . . . , M^} such 
that \hl'lwl\ > \h^'J wf\ are also decodable at the i receiver. 

The remark above conveys that for finding a decodable subset containing we need to only consider 
those subsets that contain i as well as all k such that > \hl'^wl\. Let 7rj(-) be a permutation 

operator on the indices of the users such that 

1^*'^ n-,wt n\\> ■■■> 1^''^ ^^,r ^wt ,,,, J. (25) 

By using Remarks [1] and [2] and some simple manipulations, we can compactly express the sufficient 
condition for user i to be decodable as follows. 

Remark 3 User i is decodable i/ max^-i^-^^^^^^ f{hp) ^ where 
f{i,p) ^ min \ log 1 + Z.n^=,l ..(^1 ^.^ ^26) 

Also, according to the above remark the optimal decoding set containing the i^^ user that supports 
the largest worst-case rate is the set {7rj(l), . . . , 7rj(p*)} where p* = arg max^-i^^^^^^^^ fihp)- 
Then, the rate optimization problem is given by 

maxj^ys} R, 

s.t. Ef=i«.lklf <^o, 

max^-i(i)<p<M, fi^^P) ^ R 
Ji<Pi, i = l,...,Mp. 

This beamforming optimization problem for UGDs is a non-linear non-convex problem for which 
an optimal solution cannot be guaranteed even in a centralized setup. Note that in the case that 
Pi are not identical, the problem is even more involved. 



5 Distributed Weighted Max-Min Fair Rate Allocation 

As shown in Sections 14.21 and 14.31 solving the beamforming and rate optimization problems for 
the MLD and UGD, respectively, are non-linear non-convex problems for which even centralized 
algorithms are not guaranteed to yield globally optimal solutions. Motivated by this fact and more 
importantly by the necessity for having a distributed algorithm, we propose an alternative two- 
stage suboptimal approach. We first obtain the beamforming vectors via Algorithms 1 and 2 which 



15 



provide the optimal beamformers for the MMSE receivers. In the second stage, for the given choice 
of beamformers, we exploit the fact that the MLD or UGD is used at each secondary receiver and 
allocate excess rates to secondary users in a distributed fashion. 

We denote the optimal beamforming vectors yielded by Algorithm 2 by {'w*}^^^. We use 
hi J G C to denote the combined effect of beamforming vectors (w*) and channel coefficients (h^'j). 
Thus, 

Kj = Ki i,j = l,...,Ms. 

Further, in all rate allocation algorithms proposed in the sequel, we will guarantee that each user 
receives at-least a minimum rate and the vector of minimum rates is denoted by R^™. Such 
minimum rate vector for instance, can be the vector of rates achieved by using MMSE decoders. 

We define x = [xf, . . . , xj^.jj'^ as the vector of information symbols transmitted by all secondary 
transmitters and also define = . . . , /ii,Ms]- Therefore, the signal received by the i^^ secondary 
receiver is yi = h'^x + Zi, where Zj G C accounts for the Gaussian noise as well as the interference 
seen from the primary users. Without loss of generality, we assume Zi ~ CAA(0, 1). As before 
we assume that xf, the information symbol of the z*'* user, has unit power and is drawn from a 
Gaussian alphabet. 

We use /C = {1, . . . ,Ms} to refer to the set of all secondary users and construct the vector 
^ [^i;j]j&A having the scalars hi j, where j G A, as its elements. denotes the rate vector of 
the users with indices in ^ C /C. For any two disjoint subsets A and B of /C, let C{h^,A,B) denote 
an instantaneous achievable rate region for the users in A which are jointly decoded while treating 
(suppressing) the users in B as Gaussian interferers. C{h^,A,B) is given by 

C{h\A,B) = Ir gR^:^^ "^rj <logdet I + h\)^ (^l + h^h}s"y\'Ty ca\. (27) 

Let also {Gi,Gf} denote a partition of /C such that the users in Qi are jointly decoded after 
treating those in Gf as noise. Therefore, a rate vector R is decodable using the UGD if there exist 
sets {Gi, . . . , Gms} such that i £ Qi, y i and 

Rg^ G C{h\g,,gf), for i = 1, . . . , Ms. (28) 

It is informative to compare the decodability condition for the UGD derived in (j28p with that 
for the ML decoder in (jl9p . Note that if we take Qi = {1, ■ ■ ■ , Mg} in (j28p . we obtain the condition 
in (j20p rather than the one in (jl9p . In fact for any two disjoint subsets A and B of IC such that 



16 



i £ A, hy defining 



Cih\A,B) 



r G 



Y2 — '^^^ 



H 



H 



I + /i^" ( 1 + /i^^^" ) /i: 



VPC^:iGpl, (29) 



we could instead say that R is decodable (using the UGD at each secondary receiver) if there exist 
sets {^J, . . . , Q'j^ } such that 



i(^G[ k Rg, G C{h\gl, g'-), for i = l,...,Ms. 



(30) 



However, using the fact that the UGD allows us to jointly decode any subset Qi of /C such that 
i £ Gi, it can be shown that the conditions in ()28p and ()30p are identical and hence ()28p is more 
relaxed compared to the one derived for the ML decoder in (I19p . 



5.1 Unconstrained Group Decoders 

We consider increasing the rates of all users based on some pre-determined priority, given any 
decodable rate vector R^'"" = [Rf Rf}'^]. We assign different priorities to the secondary 
users through the factors p = [pi, . . . , pM^]- By denoting the excess rate to be assigned to the i^^ 
user by rj, our objective is to maximize minjrj/pj such that i?™™ + r remains decodable where 
r = [ri, . . . , rjv/^]. For any secondary receiver i and any two non-empty disjoint subsets A,B of IC 
we define 



9ih\A,B,R^''',p) = { 



max mm^ 



pk 



(31) 



s.t. rA + RA"" ^C{h\A,B) 
which picks a rate- vector within the rate region C{h!' ,A^B) and achieves weighted max-min fairness 
for the users in A. To solve (j3T]) . we note that the region C{h^ ,A,B) can be shown to be a 
polymatroid [15, Lemma 3.4] with the rank function 



/(5)=logdet 



H 



I + hy 1 + h'l^h 



S^A. 



(32) 



The following lemma is readily verified using the properties of a polymatroid. 
Lemma 5 6{h^ ,A,B,RF^^^ , p) can he computed using 



9{h\A,B,R^''',p) = min 



A(/l^5,5,i^° 



Sj^d,SCA EjG5 Pj 



where 



A{h\S,B,R" 



log det 



H 



H 



I + hy 1 + h't^h^' \ h\ 



ie5 



mm 
'j ■ 
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Therefore, the maximum rate increment factor for sustaining weighted max-min fairness such 
that the i^^ user is decodable is given by 

e* ^ mj,x e{h\g,ic\g,R^"\p). (33) 

Based on (I33p a direct (naive) way to compute 9* is to exhaustively search all the partitions 
{Q,IC\g} such that i £ Q. Such an exhaustive search has a complexity that scales exponentially as 
0(3^^^). Our contribution is to propose an efficient algorithm that finds 9^ for each user i (along 
with an optimal partition), with a complexity that is polynomial in Mg. Before we proceed further, 
we note that A(-) has the following properties. 

A,B,C disjoint => A{h\A,BuC,R^''') + A{h\B,C,R^''') = Aih\AuB,C,R"''''), (34) 

andforanySCC ^ A{h\A,B,R^''')>A{h\A,C,R"'''')- (35) 

Now for the z*^ secondary receiver we introduce rate increments {r|, . . . , r]^,J^} where is 
the rate increment for the A;*'^ user such that the i*'' user remains decodable at receiver i and 
weighted max-min fairness is sustained, i.e., minfc{^} = 9*. Algorithm 3, provided in the sequel, 
is a computationally efficient scheme for finding the set of rate increments {r\, . . . , r\,f^} for each 
given user i. We note that since the function A(-) is sub-modular, using sub- modular function 
minimization techniques [16] we can compute 6^ in step 3 of Algorithm 3 with a complexity that is 
polynomial in \S\. Consequently, since the number of loops in Algorithm 3 can be no greater than 
Ms, Algorithm 3 itself has a complexity that is polynomial in Mg. We now prove the optimality of 
Algorithm 3. 

Theorem 2 For a given i?™™ such that the i*^ user is decodable at receiver i, the i*^ user is also 
decodable under the rate vector + r^}^;^, where {r^} is yielded by Algorithm 3. Further, 

. ri . fl 
mm — > mm — 

fcG/c pk keJC pk 

where {r\, . . . , f\,j^} is any other rate increment vector for which the i^^ user is decodable at receiver 



under the rates + 



Proof: See [17, Theorem 2]. ■ 
In Algorithm 3, user i makes rate increment suggestions for all users (including itself) denoted by 
{r\, . . . , such that the updated rate vector remains decodable at receiver i. Based on such rate 
increment suggestions by all users, we construct Algorithm 4 to determine the rate increment for 
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each secondary user. Algorithm 4 is an iterative algorithm and in each iteration each user j receives 
Ms rate increment suggestions from all users which are denoted by {rj, . . . ,r^'^°}. After receiving 
all such rate increment suggestions, the j*^ user picks the smallest rate increment suggested for it, 
i.e., mini<j<A/^ r*-. In the following theorem we prove the optimality properties of Algorithm 4. 

Theorem 3 The distributed (iterative) weighted max-min fair rate allocation algorithm has the 
following properties: 

1. It is monotonic in the sense that ^ R^"^ and is convergent. 

2. At each iteration the vector R^''^ is max-min optimal, i.e., for any other arbitrary decodable 
rate vector R ^ i?™™ we have 

mm— — > mm — , V g > 1. 

3. The rate allocation R* yielded by Algorithm 4 is also pareto- optimal, i.e., for any arbitrary 
decodable rate vector R >z -R'™° such that > KJ, for some k ^ K,, we must have that 
3j^k: Rj < R*. 

Proof: See Appendix |E] ■ 
Note that after one iteration of Algorithm 4, we can obtain another optimal rate allocation 
that satisfies a stricter notion of fairness. In particular, letting x = min^gy^; pk'' — "^ith R = 
^min ^ 2; • p we have that it is decodable and satisfies 

it^R, 

where R is any decodable rate- vector such that R = i?™"^ + x ■ p for some x > 0. 
5.2 Maximum Likelihood Decoders 

In order to address the case when the MLD is employed at each secondary receiver, we provide 
Algorithm 4MLD which can be initialized with any rate vector that is decodable when the 

MLD is employed at each receiver. The optimality of Algorithm 4MLD is stated in the following 
theorem. The proof of the theorem follows along similar lines as the one given for Theorem [3] and 
hence is skipped for brevity. 

Theorem 4 The distributed (iterative) weighted max-min fair rate allocation algorithm for the 
MLD has the following properties: 
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1. It is monotonic in the sense that R^'^^^^ ^ R^'^^ and is convergent. 

2. At each iteration the vector R^'^^ is max-min optimal, i.e., for any other arbitrary rate vector 
R y i?™™ that is decodahle using the MLD at each receiver, we have 

min— ^ ^>min— V g > 1. 

keic Pk keK. Pk 



3. The rate allocation R yielded by Algorithm 4MLD is also pareto- optimal, i.e., for any 

if 



arbitrary rate vector R ^ decodable using the MLD at each receiver, such that > 



for some k ^ }C, we must have that 3 j k : Rj < R 



ML 



6 Simulation Results 

In this section, we provide simulation results to assess the performance of different beamforming 
designs and rate allocation schemes. For convenience, throughout all the simulations we consider 
the setting Oi = pi = 1 (so that 7j = 2) for z = 1, . . . , Ms, with (3j = 5 for j = 1, . . . , Mp. 

In figures [Hand [2] we examine the rate optimization problem TZ{Po) for the MMSE and the UGD 
receivers. For this purpose we consider a cognitive radio network with three secondary transceivers 
{Ms = 3) and two primary transceivers (Mp = 2). Each primary and secondary user has three 
transmit (iVs = Np = 3) and one receive antenna, respectively. The sum power available for all 
secondary transmitters is taken to be Pq = 20 dB. We first obtain the optimal beamforming vectors 
using Algorithm 2. We then implement Algorithm 4 (with four iterations and identical priorities for 
all users) after initializing it with i?™™ = /^'^'^SE obtain the optimal rate increments. In Fig. 1, 
we consider 20 channel realizations (generated assuming all fading coefficients to be i.i.d. complex 
Gaussian) and for each realization, we plot the normalized minimum secondary rate obtained using 
the optimal beam vectors and the MMSE decoder at each secondary receiver, where the minimum 
rate is normalized by the minimum rate obtained after Algorithm 4. We also compare these results 
with the performance of MMSE receivers when the beamformers are obtained through channel 
matching, that is, the beamforming vector used by each secondary transmitter is aligned with 
channel direction to its intended receiver. The results for the latter case are also normalized by 
the minimum rates obtained after deploying Algorithm 4 with the optimized beamformers. Fig. [2] 
considers the same setup, but instead shows the normalized sum-rates. These two plots demonstrate 
that designing the beamformers through Algorithm 2 brings about considerable improvement in 
the minimum-rate and sum-rate when compared against the channel matching design. Further rate 
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gains are achievable at the expense of additional signaling overhead and advanced decoding at each 
receiver. 



Algorithm 2 + UGD Receiver 

1.2- — * — Algorithm 2 + MMSE Receiver 

— B — Channel Matching + MMSE Receiver 




2 4 6 8 10 12 14 16 18 20 



Channel Realization 



Algorithm 2 + UGD Receiver 

1 2 - — * — Algorithm 2 + MMSE Receiver 

— B — Channel Matching + MMSE Receiver 




Channel Realization 



Figure 1: UGD vs. MMSE: the normahzed 
minimum rates achieved with the sum-power 
constraint 20 dB. 



Figure 2: UGD vs. MMSE: the normalized 
sum-rates achieved with the sum-power con- 
straint 20 dB. 
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-e — Algorithm 1 + MMSE Receiver 
a - Channel Matching + MMSE Receiver 




2 4 6 8 10 12 14 16 18 20 
Channel Realization 



Figure 3: MMSE receiver: sum-power re- 
quired by Algorithm 1 vs. channel matching 
for achieving SINRj > 2, V i 



— © — ML Beamforming + ML Receiver 
- B - Channel Matching + ML Receiver 




2 4 6 8 10 12 14 16 18 20 
Channel Realization 



Figure 4: ML receiver: normalized minimum 
rates achieved using optimized beamformers 
(Section IV-B) vs. channel matching with 
the sum-power constraint of 10 dB. 



In Fig. [3] we consider the power optimization problem V{'j) for the MMSE receivers. With the 
constraints of achieving SINRj > 2 V i, we compare the sum-power required when the beamformers 
are obtained through Algorithm 1 and when they are obtained through channel matching. In 
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Figure 5: Comparing the normalized mini- 
mum rate yielded by different receivers for a 
given beamformer design. 



Figure 6: Comparing the normalized sum- 
rate yielded by different receivers for a given 
beamformer design. 



particular, we assume a cognitive radio network with four primary transceivers {Mp = 4) and three 
secondary transceivers {Mg = 3), each equipped with four transmit and one receive antenna. For 
each realization we plot the secondary sum power when the secondary transmitters employ optimal 
beams obtained using Algorithm 1. Also plotted is the secondary sum power when the secondary 
transmitters employ beams that are matched to the forward channel vectors to their respective 
intended receivers and which are then scaled subject to the SINR and margin constraints. Note that 
a careful design of the beamforming vectors can result in substantial power savings. 

In Fig. |3]we consider the rate optimization problem TZ{Pq) when each secondary receiver em- 
ploys ML decoding. We assume the same network setup as that in Fig. [3] and set the secondary 
sum power budget to be 10 dB. For each realization we plot the minimum secondary rates when 
the secondary transmitters employ optimized beams obtained using the method described in Sec- 
tion 14.21 As a comparison baseline, we have also plotted the minimum secondary rates when the 
secondary transmitters employ beamformers obtained via channel matching. The gains yielded by 
the optimized beamforming design is evident from the figure. 

Finally, in figures [5] and [6] we demonstrate the relative gains of the different rate allocation 
algorithms and the tradeoff between system efficiency and fairness. We assume that a set of beam 
vectors based on the channel matching scheme is given for each channel realization. In Fig. 
we plot the normalized minimum secondary rates obtained when each secondary receiver employs 
the MMSE decoder, the ML decoder and the UGD, respectively. The minimum rates for the ML 
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decoder and the UGD were determined using Algorithms 4MLD and 4, respectively. The Algorithm 
4MLD is initialized by setting ii™™ = 0. For initializing Algorithm 4 we have considered two cases 
with R^'"" = and R'^'"' = i^^MSE^ ^j^^^^ ^mmse ^-^^ ^^^^^^ ^^^^^ yielded by the MMSE 
receivers. All rates are normalized by that obtained for the UGD with i?™™ = 0. Note that the 
minimum rate yielded by the UGD with = is provably larger than those achieved by the 

ML and MMSE decoders as well as the one yielded by the UGD but with R'"''' = i^^MSE^ j.^^^ 
the minimum rate yielded by the UGD with J?™™ = is max-min optimal. Further, the minimum 
rate achieved by the ML decoder is seen to be sometimes smaller (albeit not always) than the one 
obtained by MMSE decoder. 

In Fig. [6]we plot the corresponding normalized sum rates. In particular, we plot the normalized 
sum rates obtained for the ML decoder and the UGD (denoted by UGD-sym) under the stricter 
notion of fairness that all users are assigned identical rate. We remark that even under this notion 
of fairness the rate vector obtained for the UGD has better efficiency than the one obtained for the 
ML decoder. The rates are normalized using the sum rate obtained for the UGD using Algorithm 
4 (denoted by UGD), with four iterations and after initializing it with i?™™ = 0. Note that the 
latter rate vector has an identical value of its minimum element but a larger sum compared to the 
one corresponding to UGD-sym since we do not insist that all elements have an identical value. 
Finally, also plotted is the normalized sum rate obtained for the UGD using Algorithm 4 (denoted 
by UGD-MMSE), again with four iterations but after initializing it with R^''^ = i^^MSE^ ^^^^ ^^^^ 
the rate vectors corresponding to UGD and UGD-sym, respectively, have a larger minimum rate 
than the one corresponding to UGD-MMSE but the latter one significantly improves the sum-rate 
(efficiency) . 

7 Conclusions 

Our focus was on decentralized multi-antenna cognitive radio networks where secondary transceivers 
co-exist with primary ones. We devised distributed algorithms for optimal beamforming and rate 
allocation in such networks. We formulated the optimization problems for the cases when the 
secondary receivers employ single-user decoders, maximum likelihood decoders and unconstrained 
group decoders. An optimal distributed algorithm is obtained for the case when each secondary 
receiver employs single-user decoding. The algorithm is optimal in the sense that it maximizes 
the minimum weighted rate subject to a weighted sum power budget for the secondary users and 
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interference margin constraints imposed by the primary users. We also obtained a centralized 
sub-optimal algorithm for the case when each secondary receiver employs the maximum likelihood 
decoder. Finally, for advanced decoders at the secondary receivers, we proposed distributed low- 
complexity fair rate allocation algorithms to boost the system efficiency and maintain a notion of 
fairness. 



A Proof of Theorem [T] 

Note that since the optimization problem corresponding to TZ{Pq) is always feasible, we conclude 
that there exists a set of beamformers such that the rate vector TZ{Po) ■ p is decodable, the margin 
constraints are satisfied and the weighted sum power does not exceed Po- Consequently, we conclude 
that V{TZ{Pq) ■ p) < Pq. Next, suppose the optimization problem corresponding to V{p) is feasible 
and let {w*} be the optimal set of beamformers with = 'Pip)- Then since for the 

beamformer design {w*} the rate vector p is decodable and the margin constraints are satisfied, 
we must have that TZ{V{p)) > 1. On the other hand, TZ{V{p)) cannot exceed 1. If it does, using 
the fact that TZ{Pq) is continuous and non-decreasing in Pq, we can conclude that there exists a 
set of beamformers {wi} with Xli^i = < 'P{p) and at the same time TZ{Pq) = 1. This 

means that p is decodable and the margin constraints are satisfied which contradicts the optimality 
of V{p) and hence we must have TZ{V{p)) = 1. 



max 



B Proof of Lemma [2] 

We first find an upper bound on the term in (jlip as follows. 

mm ■ ^ mm ■ = mm ■ i 

[QTT^Q%,, ^ f 1 ^ [QTT^Q%, 

\[QTW ) -{us + Mp^ \[QTU^ J ■ 

(36) 

Assuming the singular value decomposition (SVD) QT = UAV^ such that Ui and Vi are the i*'* 
rows of the unitary matrices U and V, respectively, we get 
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where ()^ denotes the pseudo-inverse operator and the inequahty above holds due to Cauchy- 
Schwartz inequahty. Considering ()36|) and ()37p and using the harmonic mean-arithmetic mean 
inequahty we get 



mm 



\[Qn 



< 



i EjVi I [QT]ij\^ + (T{i) - \Ms + Mp^ [{QT)^QT] 



< 



Ms + M^ 



Ms + Mp 
tT[{QT)^QT] 



Ms + Mp f Ms + Mp _ 

rank [QT] J - \ rank[Q] 



Therefore, to satisfy ah the SINR constraints it is necessary that ( ^^^^ — 1 



-1 



> 1. 



(38) 



C Proof of Lemma [3] 



By rearranging the constraints in (jlip and using the definitions of Q and T we have 

2 



AIs+Mp 

2|[QT]i,ip> ^ \[QT]ij\'' + a{i 



{QTY e 



iov i = 1,. . . ,Ms + M. 



where is a column vector of length Mg + Mp with its i element 1 and the rest 0. As the 
angular rotation of the beamforming vectors with any arbitrary phase does not affect either the 
objective or any of the constraints of V{y), therefore we confine the solution to satisfy [QT]i^i > 
for i = 1, . . . , Mg. Also note that for j > Mg, [QT]ij is a fixed value. Hence, Pif) is equivalent to 



mm 



v^Ma II ~s||2 

V2\[QT],,i\ 



s.t. 



y^O, fori = 1,...,M, +M„ 



(39) 



Since for i > Mg we have |[Qr]j^j| = [QT]i^i = 1, the constraints in (j39p are all second order 
cones. Therefore since the objective function is convex, (j39p is a convex problem for which strong 
duality holds and the primal and the Lagrangian dual problems achieve the same optimal value. 
The Lagrangian dual of (p9]) is given by 



Lii{wt},D) 



Ms 
i=l 



Ms+Mp 



i=l 



V2[QT\i 



(40) 
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where D = diag(di, . . . , dMs+Mp) and the Lagrangian dual objective function is 



5i(£») = minLi {{wl],D). 
Because of the convexity of (j39p we have ^(7) = max£)j_g gi{D). Defining 



(41) 



(<5T)^e, 



along with some manipulations on Li(-, •) yields 



(42) 



Ms 



Ms+Mp , / 

d 



i=l 
Ms 



i=l 



2[QT] 



1,1 



Ms 



di 



i=l i=l * j 

Mr, J ( 



i=l 



QMs+i 



(43) 



Note that the {qi} as defined in (|42p are strictly positive. As a result, we may replace the Lagrangian 
coefficients with ipi = ^ for i = I, . . . , Ms + Mp and upon re-writing we can readily verify it 
to be identical to the Lagrangian dual of (jlOp having the dual variables {fj}- Therefore, by taking 
into account that (jlOp and (j39p are equivalent and their Lagrangian duals are the same, they should 
exhibit identical duality gap. On the other hand, (|39p is convex and satisfies Slater's condition and 
thus has a zero duality gap. As a result, exhibits a zero duality gap too. 



D Proof of Lemma [4] 

Consider any rate vector R satisfying the condition in p9p . Let e > be arbitrarily fixed and let 
C be the ensemble of multi-user codebooks corresponding to any rate vector R' -< R. Define any 
multi-user codebook (i.e., a set of Mg codes, one for each secondary user) by C G C and define 
Ei(C) as the error event for user i (at its designated receiver) when the multi-user codebook C 
is employed. We assume that the multi-user codebooks are picked using the product Gaussian 
measure, i.e., each coordinate of each codeword of each user is generated independently using a 
Gaussian distribution with zero-mean and unit variance. Our objective is to show that there exists 
at-least one multi-user codebook C for which Pv{Ei{C)) < e, V i. 
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For this purpose, we consider the term Pr{nfLi{PT{Ei{C)) < e}), where the outer probability 
is over the set C and the inner probabihty is over the set of all noise realizations. We obtain the 
following bound 

Ms 

Pr (nfi\{PriEi{C)) < e}) = 1 - Pr (ufi\{PT{E,{C)) > e}) > 1 - ^ Pr(Pr(i?,(C7)) > e). (44) 

1=1 

Using Markov's inequality, we obtain 

l-gp.(P,(^,C))>,2 1-E3£«. 

1=1 1=1 ^ 

Next at any receiver i, the event Ei{C) is the union of 2*-''="^ disjoint events, where the k^^ event is 
the event that errors occur only for all users in the set , for /c = 1, • • • , 2*^^~^, respectively. Then 
since the rate vector R satisfies the condition in ()19p . it can be verified using the random coding 
upper bounds and the techniques developed in [13] that the terms {E[Pr(£'j(C))]}^^°-^ can be made 
arbitrarily small. Thus, for sufficiently long codeword lengths the term Pr(n^|{Pr(£'j(C)) < e}) 
is bounded away from zero and hence we can conclude that exists at-least one multi-user codebook 
C satisfying the power constraints, for which Pr(£'j(C)) < e, V i. 



E Proof of Theorem [3] 

Claim 1: 

Since i?™™ is decodable, as an straightforward application of Theorem [2] we find that i?^^^ is also 
decodable and i?^^^ ^ i?™"^. In general, at the {q + 1)*'^ iteration for finding the rate vector R^'^'^^^ 
we have set = and again by using Theorem [2] we conclude that R^'^^^^ is decodable and 

^(g+i) ^ ^(9)^ Finally, as the set of rate vectors {R^'^^^^} is monotonically increasing and the set 
of decodable rate vectors is bounded, the convergence is guaranteed. 
Claim 2: 



By invoking R^'^'^ ^ • • • ^ R^^'^ from the first part we get 



Dinin 



mm— S — >--->min— ^ — . (45) 

fcG/C Pk keK. Pk 

Now, for the given rate vector R let us define Pf. = — -R™™ for i = l,...,Ms. By noting 
that R^^^ = ii™™ + mini<j<A./s{^fc}; where {r^} are the rate recommendations made after the first 
iteration, we get 



. Rk -Rf"" . mini<,<A/,{r^} . . ^ . . 

mm = mm = mm mm — > mm mm — 

fce/C Pk keK. Pk l<i<Ms keK. Pk l<i<Ms fcG/C Pk 
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. ri . . Rk - Rf" . Rk - Rf" ,,v^ 

= mm mm — = mm mm — = mm — , (47) 

fce/c i<i<Ms Pk fce/c i<i<M^ Pk fce/c pk 

where (I46p holds due to Theorem [2j By putting together ()45p and ([470 the desired result is 

established. 

Claim 3: 

We consider the output of Algorithm 4 and show that for this rate allocation, any increase in the 
rate of any user will incur a decrease in the rate of some other user and thus, R* is the pareto- 
optimal solution. For this purpose, we investigate the possibility of increasing the rate of a specific 
user while keeping those of the others' unchanged. Without loss of generality we examine whether 
the rate vector R = {R\ + e, i?2, . . . , R*m^} is decodable for some e > 0. 

At each iteration, each specific user receives rate increment suggestions by all other users among 
which the user with the lowest rate increment suggestion identifies the rate increment for that spe- 
cific user. At the final iteration, let us assume that the lowest rate increment recommendation for 
user 1 is made by the i*^ receiver, i.e., r\ = minjjrj} = 0. Also, let {B^ , . . . , , B"^^^, . . . , B^} de- 
note the sets found at the i*^ receiver by Algorithm 3 in the last iteration of Algorithm 4, using R* as 
the minimum rate vector and denote their respective corresponding values by {(5^ , . . . , 5"^ , 5*"+^ , . . . ,S^}. 
Suppose i G and since the i^'^ user must be decodable, we must have (^™+^ > 0. Using the 

arguments employed in the proof of [18, Theorem2], we can show that 5^ < 5^ < ■ ■ ■ < 6f. Based 
on this observation we can deduce the following properties for the sets {B^} and {5*}: 

1. (^""^^ > 0: Clearly when (5"^+^ > we must have 5™+^ > 0. Now suppose 5"^+^ = so that 

> 0. Assume = 0. Then, since A{h\B'^+^,UfJ'^^B^ ,R*) = A{h\B'''+\uf^-^B^ ,R*) = 
it can be shown that A(/i*, 5"*+^, U^^fi-', i?*) = 0. This is a contradiction since it im- 
plies that in Algorithm 3, line 3, we could have chosen instead of B"^^^. Thus, 

2. 1 G B^~^^: First, 1 ^ B^ for j < m since otherwise the i*'' user would recommend rl = -\-oo 
which is a contradiction. On the other hand, if z E B^ for j > m + 2 then the i*'' user would 
recommend the rate increment 6^ pi > which is also a contradiction. 

3. (5™+^ = 0: Since 1 G B"^~^^, due to R* being the convergence point, S^"^^ cannot be greater 
than zero as otherwise it leads to a higher rate for the 1^* user. By taking into account that 
6'"-+^ > we get 6"^+^ = 0. 

Recall that we have 6^ < ■ ■ ■ < 6^. Now, define n G {0, . . . , m} such that 5^ < ■ ■ ■ < 5^ < and 
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d^~^^ = ■ ■ ■ = = and construct the sets 

V- = e^U-.-U^", and po = e"+iu---Ue™+\ and V+ = 8""+^ U ■ ■ ■ U BP. 

Also recall that R ^ R* . Consequently, it follows that no user with index in 'D~ can be decoded 
at receiver i, under the rate assignment R. Thus, the users in T>~ must be treated as Gaussian 
interferers. Next since the rates of the users in 2?+ remain unaltered, these users are decodable 
using the partition {U^^^_^2'^"'i ^\ ^^=m+2 ^'^} under the rate assignment R. Thus, without loss 
of optimality, we can assume that these users have been perfectly decoded and expurgated. 

Let us focus on any arbitrary partitioning of users U 'D^\Q}, such that i £ Q. Our 

objective is to show that user i is not decodable under the rate assignment R using any such par- 
tition. First consider the case 1 ^ G. For user i to be decodable we must have A{h^ ,G ,'D~ U 
V^\g,R) = A{h\g,V~ UV°\g,R*) > O. Using the fact that 5"+^ = 0, we can conclude 
that A{h\V^\g,V",R*) > 0. However, since A{h\V^,V- , R*) = we must have that both 
A{h\g,V~ UV^\g,R*) and A{h\V'^\g ,V~ , R*) are equal to zero. Again using the fact that 
5*^+1 = 0, we can conclude that A{h\V\g U {[Jf^^^_^^B^),V~ ,R*) > 0. However since both 
A{h\LIJL^^^B^,V-,R*) and A{h\V°\g,V-,R*) are zero, we must have that 

Aih\ (P0\g)\(u- ,+1^^-), iU]l^^,BnuV-,R*) = 0. 

This yields us the desired contradiction since the set {V°\g)\{U'Jl^^^^B^) does not contain i but 
was not selected instead of B'^'^^ in step 3 of Algorithm 3. Consequently, we can conclude that i is 
not decodable using {g, V- [JV\g] under rate assignment R* and hence under rate assignment R. 
Finally, we need to rule out partitions {g, [J'D^\g^ such that 1, z G g. For user i to be decodable, 
we must have A{h\g,V~ UV^\g,R) > 0. Using the facts that (5"+^ = and 1 ^ V^\g, we can 
conclude that A{h\'D\g ^V" , R) > 0. These facts together provide that A{h\T>°,T>-,R) > 0. 
However, this is a contradiction since A(/i*, D", i?*) = and R > R* with Ri > i?^. 
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Algorithm 1- Solving ^(7) 

1: Input a, 7, /3, and {/i^ }, K^}, K^} 

2: Define {/iij }, {/if.-, } as specified in (|9} 
3: Initialize A and k = 1 
4: repeat 

5: Construct U i as in (|12|l : obtain hj'j — h"'"U~^ 
6: Solve g{\) using the distributed algorithm of [7] and find {wf} 
7: Obtain {lyf } using transformation wf = U^^wf 
8: Calculate the subgradient s'''' as in (|17|l 
9: Update A(*+^' = A^''^ - is'*) and fc ^ fc + 1 
10: until convergence 

11: Output = {^li^a and Vif) ^ Y.^'^Al^tf 



Algorithm 2 - Solving 7^(Po) 



1: 


Input a, p, /3, 5 and {hf-^}, {h^J}, {hi;}, {h^^^} 


2: 


Initialize p^in = mini<i<M, {log(l + ,,, . )/pi} and 




Pmax = mmi<i<M,{log(l + Po ^.(^sj )/pi} 


3: 


PO ^ Pmin, 7 ^ 2""" - 1 


4: 


repeat 


5: 


Solve P(7) using Algorithm 1 


6: 


if Po > P(7) 


7: 


pmin ^ Po; update {luf } 


8: 


else 


9: 


Pmax <— Po 


10: 


end if 


11: 


po ^ (pmin + Pmax)/2 aud 7 ^ 2"°" - 1 


12: 


until pmax - Pmin < & 


13: 


Output TZ{Pq) — Pmin aud {lof } 
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Algorithm 3 - Rate increment recommendations by individual receivers 



1: Initialize 5 = /C and 6? = and 0' = and A; = 

2: repeat 

3: Fmd 5 = mms^e^sca EjgB Pi — ^ = argmmB^0^BC5 ^^.^g — ^ 

If there are multiple choices for S*^ pick any one such that i 
4: if i G or i e G 

5: r] = 5''>j for all j e B*' and S ^ S\B'' and ^ ^ U B*^ and ^ B'' U and k ^ k + 1 

7: else 

8: r] = +00 for all j £ B'' , S ^ S\B'' and ^ S U S'' , fc ^ fc + 1 

9: end if 

10: until 5 = 

11: Output {rl} and 5' 



Algorithm 4 - Distributed Weighted Max-Min Fair Rate Allocation 

1: InitiaUze J?™'" and g = 

2: repeat 

3: for i = 1, . . . , Ms do 
4: Run Algorithm 3 

5: end for 

6: Update g ^ g + 1 and i?^"^ = E^" + mini<,<M, {rl} and i?™ ^ i?'") 

7: until ii''' converges 

8: Output R* = and {G'}'^L\ 



Algorithm 4MLD - Distributed Weighted Max-Min Fair Rate Allocation for MLD 

1: Initialize fl™'" and g = 

2: repeat 

3: for i = l,...,Ms do 

4: Initialize S — IC 

5: repeat 

6: Fmd d = mmg^igg^Bcs — 



en 



7: S = arg mins.eB.BCs ^'^'^^'^'f 

8: rj = 5pj for all j £ B 

9: 5 

10: until 5 = 

11: end for 

12: Update g ^ g + 1 and i?^"' = ff^"" + mini<,<A/, {r^ and i?""" fl'"' 

13: until RS''^ converges 

14: Output R^^ = 
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